Presentation: Tweet"LMAX Disruptor - 100K transactions per second at less than 1ms latency"

Track: Architecture Case Studies / Time: Tuesday 10:20 - 11:20 / Location: Rytmisk Sal, Musikhuset

Conventional wisdom says that memory is fast, disk is slow, networks are slower and that fast systems must be highly parallel to achieve maximum performance. Much of this is outdated and some of it is now wrong. Modern hardware is phenomenally fast, but we have become complacent and use it in extremely inefficient and inappropriate ways.

For world class performance on commodity hardware you need to take a holistic approach to software design. The good news is that all the stuff we learned in computer science 101 is what really matters, choose your data structures carefully, model your domain, understand your platform, work hard to have a clear separation of concerns, but as well as all of that, run your business logic on a single thread!?

This session cover the development of the LMAX "Disruptor" concurrency pattern. This pattern is a significant step forward for concurrency control of multi-stage processes over using existing queue-based techniques. It does this delivering significantly improved throughput at lower latencies, and is now an open source project.

This session will describe some of the challenges faced developing the World's fastest financial exchange - little things like how to do over 100K/tps at less than 1ms latency yet still have full HA support in a distributed environment.

Open Source Project: http://code.google.com/p/disruptor/
Keywords: Java, Concurrency, Parallel Programming, High Performance

Download slides

Dave Farley, TweetCo-author of the book "Continuous Delivery"

Biography: Dave Farley

Dave Farley has been having fun with computers for nearly 30 years. Over that period he has worked on most types of software, from firmware, through tinkering with operating systems and device drivers, to writing games, and commercial applications of all shapes and sizes. He started working in large scale distributed systems about 20 years ago, doing research into the development of loose-coupled, message-based systems - a forerunner of SOA. He has a wide range of experience leading the development of complex software in teams, both large and small, in the UK and USA. Dave was an early adopter of agile development techniques, employing iterative development, continuous integration and significant levels of automated testing on commercial projects from the early 1990s. Dave is currently Head of Software Development for LMAX ltd, an organization that is building one of the highest performance financial exchanges in the world.

Follow him on twitter: @davefarley77

Book:Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation (Addison-Wesley Signature Series (Fowler))

Martin Thompson, TweetCTO and co-founder of LMAX

Biography: Martin Thompson

Martin has had a passion for pushing software and electronics to the limit since childhood. He was the type of kid who took the video recorder apart and then fixed it. Since then he has always been attracted to business problems where high performance computing can open new, previously impossible, opportunities. Ranging from stock market data feeds to PCs as in the early 90s, working on the first generation of internet banks, implementing the largest product content management systems, working on the worlds largest sports betting exchange (Betfair) and now founding LMAX. Martin brings his mechanical sympathy for the hardware that it runs on, to the software that he creates, which has taken him deep into the subjects of concurrency and parallel computing. Martin is the co-founder and CTO of LMAX where he leads the building of the world’s highest performance financial exchange using a radical new architecture that takes it all back to basics.

Twitter: @mjpt777
Video presentations: 4 Years of living Continuous Delivery - TDD of a business plan